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Abstract 

In the design of multiple description lattice vector quantizers (MDLVQ), index assignment plays 
a critical role. In addition, one also needs to choose the Voronoi cell size of the central lattice v, the 
sublattice index N, and the number of side descriptions K to minimize the expected MDLVQ distortion, 
given the total entropy rate of all side descriptions Rt and description loss probability p. In this paper 
we propose a linear-time MDLVQ index assignment algorithm for any K >2 balanced descriptions in 
any dimensions, based on a new construction of so-called A'-fraction lattice. The algorithm is greedy in 
nature but is proven to be asymptotically {N oo) optimal for any K > 2 balanced descriptions in 
any dimensions, given Rt and p. The result is stronger when K — 2: the optimality holds for finite N 
as well, under some mild conditions. For K > 2, a local adjustment algorithm is developed to augment 
the greedy index assignment, and conjectured to be optimal for finite N. 

Our algorithmic study also leads to better understanding of ly, N and K in optimal MDLVQ design. 
For K ~ 2 we derive, for the first time, a non-asymptotical closed form expression of the expected 
distortion of optimal MDLVQ in p, Rt, N. For K > 2, we tighten the current asymptotic formula of 
the expected distortion, relating the optimal values of N and K to p and Rt more precisely. 
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I. Introduction 

Recent years have seen greatly increased research activities on multiple description coding (MDC), 
which are motivated by cooperative and distributed source coding for network communications. In a 
packet-switched network such as the Internet, an MDC-coded signal is transmitted in multiple descriptions 
(called side descriptions) via different routes from one or multiple servers to a receiver. Each side 
description can be independently decoded to reconstruct the signal at certain fidelity, while multiple 
side descriptions can be jointly decoded to reconstruct the signal at higher fidelity. By utilizing path 
diversity (the ability to communicate a content over different paths from a server to a client) and server 
diversity (the possibility of transmitting a source from multiple servers), MDC codes can weather adverse 
network conditions much better than single description codes, particularly in real-time communications 
where retransmission is not an option. 

Multiple description codes can be generated by three categories of techniques: quantization, correlating 
transforms and erasure correction coding [1]. This paper is concerned with the approach of multiple 
description lattice vector quantization [2], [3], [4], [5], [6], [7], [8], [9], [10]. 

The first practical design of multiple description quantizer was the multiple description scaler quantizer 
(MDSQ) proposed by Vaishampayan in 1993 [11]. The key mechanism of Vaishampayan's technique is 
an index assignment (lA) scheme. In the case of two descriptions, the lA scheme labels each codeword of 
central quantizer by an ordered pair of indices, one for each side quantizer. MDSQ first quantizes a signal 
sample to a central quantizer codeword, then maps, via index assignment, this codeword to a pair of side 
quantizer indices. Vaishampayan proposed few index assignments for two-description balanced MDSQ 
[II]. These index assignments, although asymptotically good, were shown by Berger-Wolf and Reingold 
to be suboptimal [12]. The authors alternatively formulated MDSQ lA as a combinatorial optimization 
problem of arranging consecutive integers in a K-dimensional matrix similarly as in graph bandwidth 
problem [12]. With this formulation they proposed a constructive algorithm for MDSQ index assignment. 
The resulting index assignment was shown to minimize the maximum side distortion given central 
distortion, but only for a special case of two balanced description MDSQ when the index assignment 
matrix has no null elements (i.e., the number of central codewords is equal to the square of the number 
of side codewords, corresponding to having no redundancy in the system). Moreover, the technique of 
optimizing index assignment by arranging integers in a matrix cannot be extended to multiple description 
vector quantization (MDVQ), because no hnear ordering of code vectors in two or higher dimensions 
can preserve spatial proximity. 
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Theoretically, MDVQ can achieve the MDC rate distortion bound as block length approaches infinity. 
Unfortunately, optimal MDVQ design is computationally intractable (optimal single-description VQ 
design is already NP-hard [13]). A practical way of managing the complexity is to use lattice VQ 
codebooks. This reduces the MDVQ design problem to one of choosing a lattice A for central description 
and an associated sublattice Ag for K > 2 side descriptions, and estabUshing a one-to-one mapping, 
called index assigimient a, between a point A G A and an ordered K-tuple {\i,...,\k) € A^. The 
above MDVQ scheme was first proposed by Servetto et al. [2], and commonly referred to as multiple 
description lattice vector quantization (MDLVQ). Given the dimension of source vectors, lattices A and 
Kg can be selected from the known optimal and/or near-optimal lattice vector quantizers (e.g., those 
tabulated in [14]). Therefore, the key issue in optimal MDLVQ design is to find the bijection function 
a : A a (A) C A^ that minimizes a distortion measure weighted over all possible channel/network 
scenarios. 

The seminal paper of [4] studied the index assigimient problem for K = 2 balanced MDLVQ in 
considerable length, and proposed a "guiding principle" for constructing an optimal index assigimient 
for two balanced descriptions. Also, the authors pointed out that optimal MDLVQ index assignment is 
a problem of linear assignment. However, a challenging algorithmic problem remains. This is how to 
reduce the graph matching problem from an association between two infinite sets A and h.f to between 
a finite subset of A and a finite subset of A^, and keep these two finite sets as small as possible without 
compromising optimality. 

Diggavi et al. proposed a technique of converting the index assignment problem for two description 
lattice VQ to a finite bipartite graph matching problem [5]. Two sublattices Ai, A2, and their product 
sublattice of A^ are used to construct the two description LVQ. The index assignment is obtained by a 
minimum weight matching between a Voronoi set of central lattice points and a set of edges (ordered pairs 
of sublattice points, one end point in Ai and the other in A2). Each set has a cardinality of N1N2, where 
Nk is the index of A^, k = 1,2. Therefore, the index assignment can be computed in 0{{NiN2)^/^) 
time, given that the weighted bipartite graph matching can be solved in 0{N^/'^) time [15]. 

In [5] the authors only argued their index assignment algorithm to be optimal for two description 
lattice scalar quantizers, and left its optimality for lattice vector quantizers unexamined. This technique 
of constructing MDLVQ using a product sublattice was extended from two descriptions to any K 
balanced descriptions by 0stergaard et al. [10]. 0stergaard et al. also used hnear assignment to find 
index assignments. Their solution seemed to require 0{N^) time, where N is the sublattice index, 
because it used a candidate set of 0{N^) central lattice points. Even with such a large set of candidate 
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central lattice points, still no bound was given on the size of the candidate K-tuples of sublattice points 
used for labeling, and no proof of optimality was offered. 

In this paper we propose an 0{N) greedy index assignment algorithm for MDLVQ of any K > 2 
balanced descriptions in any dimensions. We prove that the algorithm minimizes the expected distortion 
given the loss probability p and entropy rate Rg of side descriptions, as ^ oo. Moreover, for K = 2, 
we can prove, under some mild conditions, the optimality of the algorithm for finite as well. For K > 2 
and a finite N, we augment the greedy algorithm by a fast local adjustment procedure, if necessary. We 
conjecture that this augmented algorithm is optimal in general. 

The remainder of the paper is structured as follows. The next section formulates the optimal MDLVQ 
design problem and introduces necessary notations. Section |ffl] presents the greedy index assignment 
algorithm. An asymptotical (A^ oo) optimality of the proposed algorithm is proven in Section |W] 
Constructing the proof leads to some new and improved closed form expressions of the expected MDLVQ 
distortion in A^ and K, which are also presented in the section. Section |3 sharpens some results of the 
previous section for two balanced descriptions, by proving the optimality and deriving an exact distortion 
formula of the proposed algorithm for finite A^. The non-asymptotical results of Section |V] use a so-called 
S'-similar sublattice. Section EI shows that common lattices in signal quantization do have S'-similar 
sublattices. Considering that the greedy index assignment may be suboptimal for finite A^ when K > 2, 
we develop in Section IVIll a local adjustment algorithm to augment it. Section fVIIll concludes. 



In a K-description MDLVQ, an input vector x G is first quantized to its nearest lattice point 
A G A, where A is a fine lattice. Then the lattice point A is mapped by a bijective labeling function 
a to an ordered K-tuple (Ai, A2, • • • , Ax) G Af-, where is a coarse lattice. Let the components of 
a be {ai,a2,-" tC(k), i-c, = A^, I < k < K. With the function a the encoder generates K 

descriptions of x: A^, I < k < K, and transmits each description via an independent channel to a 
receiver. 

If the decoder receives all K descriptions, it can reconstruct x to A with the inverse labeling function 
a^^. In general, due to channel losses, the decoder receives only a subset x of the K descriptions, then 
it can reconstruct x to the average of the received descriptions: 



II. Preliminaries 
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Note the optimal decoder that minimizes the mean square error should decode x to the centroid of the 
points A G A whose corresponding components q(A) are in x- But decoding to the average of received 
descriptions is easy for design [9]. It is also asymptotically optimal for two description case [4]. 

A. Lattice and Sublattice 

A lattice A in the L-dimensional Euclidean space is a discrete set of points 

A = {A G : A = uG, n G Z^}, (1) 

i.e., the set of all possible integral linear combinations of the rows of a matrix G. The L x L matrix 
G of full rank is called a generator matrix for the lattice. The Voronoi cell of a lattice point A G A is 
defined as 

V{X) = {xeR^ : \\x - All ^ \\x - A||,VA G A}, (2) 

where \\x\\'^ = {x,x) is the dimension-normalized norm of vector x. 

Two lattices are used in the MDLVQ system: a fine lattice A and a coarse lattice Ag. The fine lattice A 
is the codebook for the central decoder when all the descriptions are received, thus called central lattice. 
The coarse lattice A^ is the codebook for a side decoder when only one description is received. Typically, 
As C A, hence A^ is also called a sublattice. The ratio of the point densities of A and A^, which is 
also the ratio of the volumes of the Voronoi cells of A^ and A, is defined as the sublattice index N. If 
the sublattice is clean (no central lattice points lie on the boundary of a sublattice Voronoi cell), is 
equal to the number of central lattice points inside a sublattice Voronoi cell. Sublattice index N governs 
trade-offs between the side and central distortions. We assume that A^ is geometrically similar to A, i.e.. 
As can be obtained by scaling, rotating, and possibly reflecting A [14]. Fig. ^is an example of hexagonal 
lattice and its sublattice with index = 31. 

Let G and Gs be generator matrices for L-dimensional central lattice A and sublattice A^,. Then A^ is 
geometrically similar to A if and only if there exist an invertible L x L matrix U with integer entries, a 
scalar (3, and an orthogonal L x L matrix A with determinant 1 such that 

Gs = UG = PGA, (3) 

The index for a geometrically similar lattice is = = P^. 
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Fig. 1. Hexagonal lattice A2 and its sublattice with index = 31. Central lattice points are marked by small dots, and 
sublattice points by big dots. 



B. Rate of MDLVQ 

In MDLVQ, a source vector x of joint pdf g{x) is quantized to its nearest fine lattice A G A. The 
probability of quantizing x to a lattice A is 

P(A)= / gix)dx. (4) 
JviX) 

The entropy rate per dimension of the output of the central quantizer is [4] 

i2e = ^^P(A)logP(A) 

AeA 



tXI / 9{x)dxlog2 I g{x)dx 

I 9{x)dx\og2g{X)v 
f-i Jv(X) 



^AeA 



= Hp) - 7;i°g2 ^-^ 

where v is the volume of a Voronoi cell of A, and h{p) is the differential entropy. The above assumes 
high resolution when g{x) is approximately constant within a Voronoi cell V{\). 

The volume of a Voronoi cell of the sublattice A^ is Ug = Nv. Denote by Q{x) = A the quantization 
mapping. Then, similarly to the entropy rate per dimension of a side description (for balanced 



February 1, 2008 



DRAFT 



7 



MDLVQ) is [4] 

Rs = jH{ak{Q{X))) 

~ Hp) - ^ iog2 '^s (6) 

= h{p) - jlog^iNu). 
The total entropy rate per dimension for the balanced MDLVQ system is 

Rt = KRs. (7) 

C. Distortion of MDLVQ 

Assuming that the K channels are independent and each has a failure probability p, we can write the 
expected distortion as 

k=0 ^ ^ 

where D}. is the expected distortion when receiving k out of K descriptions. 

For the case of all descriptions received, the average distortion per dimension is given by 

dc = / \x — \\\ (j{x)dx G hv'i^ , (8) 

where Ga is the dimensionless normahzed second moment of lattice A [14]. The approximation is under 
the standard high resolution assumption. 

If only description i is received, the expected side distortion is [4] 



di = y^ \\x - XiW"^ g{x)dx 

= y / (\\x- Xf + \\\- Xif + 2{x- X,\- Xi)) g{x)da 



(9) 



^ dc + ^\\X- Xif P{X), l<i<K 
AeA 

Hence the expected distortion when receiving only one description is 

K K 

i=l AeA i=l 

Let rriK be the centroid of all K descriptions Ai, A2, • ■ ■ > ^k, that it, 

1 ^ 

mK = j^^Xk. (11) 
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Then we have 

K 



1 ^ 2 1 ^ 



1=1 



i=l 

2 1 22/ ^ 



m/f ) 



(12) 



i=l 



= ||A - niKlf + ^ XI ll-^* ~ "^i^ll^- 

i=l 

Substituting STU into ( fT(3l . we get 

/ 1 K 

-Di = 4 + ||A - rnxf + ^Y1 ll^' 

AeA V i=l 

Now we consider the case of receiving k descriptions, 1 < k < K. Let I be the set of all possible 
combinations of receiving k out of K descriptions. Let t = (ti, i2, • ' ' ) ^^fc) be an element of 1. Under 
high resolution assumption, we have [10] 

k 



rriKl 



P{X). 



(13) 



dr. 



AeA tGi 



k^ ' 



P(A) 



aga \ 



K -k 1 



K 



(14) 



iK -l)kK^ 
Substituting the expressions of into we arrive at 



P(A), 1< A; < K. 



D = (1 + E II A - m;^f + C2;^ E 11^* - "^^ll'l ^(A) +^"^^^[11^1 

aga V i=i J 



(15) 



where 



K-l 



c. = E 



fe=i 

K-l 



C2 = E 



(16) 



D. Optimal MDLVQ Design 

Given source and channel statistics and given total entropy rate Rt, optimal MDLVQ design involves 
(i) the choice of the central lattice A and the sublattice A^; (ii) the determination of optimal number of 
descriptions K and of the optimal sublattice index value A^; and (iii) the optimization of index assignment 
function a once (i) and (ii) are fixed. We defer the discussions of optimal values of K and A^ to Section 
HVl and first focus on the construction of optimal index assignment. It turns out that our new constructive 
approach will lead to improved analytical results of K and A^ in optimal MDLVQ design. 
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With fixed p, K, A, A^, tiie optimal MDLVQ design problem (i.e., minimizing (fTSb ) reduces to finding 
the optimal index assignment a that minimizes the average side distortion 



agA 



K ^ 



|a,(A) - //(a(A))f + C||A - /x(a(A))f P(A), 



where 



K 



;u(a(A)) =i^-i^a,(A) 

i=l 

^2 Ef.Y(I)(i-P)'=P^-^(|f^,' 



IK 

When iiT = 2, the objective function can be simplified to 

|2 



4 




A, 



+ 



A 



Ai + A2 



|P(A). 



(17) 



(18) 



(19) 



III. Index Assignment Algorithm 

This section presents a new greedy index assignment algorithm for MDLVQ of K > 2 balanced 
descriptions and examines its optimality. The algorithm is very simple and it henges on an interesting new 
notion of AT-fraction sublattice. We first define this AT-fraction sublattice and reveal its useful properties 
for optimizing index assignment. Then we describe the greedy index assignment algorithm. 



A. K-fraction Sublattice 

In the following study of optimal index assignment for K balanced descriptions, the sublattice 

A./i^ = ^A, = {rGM^:r = ^G„nGZ^} (20) 

plays an important role, and it will be referred as the AT-fraction sublattice hereafter. 

The A'-fraction sublattice A^/^ has the following interesting relations to A and A^. 

Property 1: /x(a(A)) = K~^Ylk=i Q^fc(A) ^^^^ (but not one-to-one) map: A^ — > A.^/^- 

Proof: 1) (Ai, A2, • • • , A;^) G Af ^ ^f^^ A^ G A, ^ ^"'Ef=i Afc G A,/^; 2) Vr G A,/^, let 
Ai = Kt, X2 = ■ ■ ■ = Xk = 0, then Ai, A2, • • • , Xr & and fi{a{X)) = r. ■ 

This means that the centroid of any A' -tuples in A^ must be in A^/X' and further A^/x consists only 
of these centroids. 

If two A'-fraction sublattice points ti,T2 satisfy ti — T2 G A^, then we say that ri and T2 are in the 
same coset with respect to A^. Any AT-fraction sublattice point belong to one of the cosets. 
Property 2: Ag/^ has, in the L-dimensional space, cosets with respect to A^. 
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Proof: Let ti,T2 be two K-fraction sublattice points. ti,T2 can be expressed by 

where u = {ui,U2,--- ,ul) G Z^,?; = (fi,f2,-'" i^^l) S Z^. Two points ri and r2 fall in the same 
coset with respect to if and only if Ui = Vi mod K for alH = 1, 2, • • • , L. The claim follows since 
the reminder of division by K takes on K different values. ■ 
The K-fraction sublattice Ag^x partitions the space into Voronoi cells. Denote the Voronoi cell of a 
point r G A^/^ by 

Vs/KiT) = {x : \\x - t\\ < \\x - f\\ , Vf G As/k}. 

Property 3: Ag/^ is clean, if A^ is clean. 

Proof: Assume for a contradiction that there was a point A G A on the boundary of Vs/k{t) for 
a r G Agjj^. Scaling both A and Vgij^{T) by K places K\ on the boundary of KVgii^{T) = {Kx : 
\\Kx — Kt\\ < \\Kx — Kf\\ ,Vf G Ag/j^}. But KX is a point of A, and KVg/xiT) is nothing but the 
Voronoi cell Vg of the sublattice point Kt G A^, or the point KX G A lies on the boundary of Vs{Kt), 
contradicting that A^ is clean. ■ 
Property 4: Both lattices A^ and A are symmetric about any point r G A^/2- 

Proof: Vr G A^/2' we have 2r G A^, so 2r — Ag G A^ holds for VA^ G A^; similarly, Vr G Ag/2> 
we have 2t G A, so 2r - A G A holds for VA G A. ■ 

B. Greedy Index Assignment Algorithm 

Our motive of constructing the i^-fraction lattice Ag/x is to relate Ag/^^ to the central lattice A in 
such a way that the two terms of dg in (fTTt can be minimized independently. This is brought into light 
by examining the partition of the space by Voronoi cells of iC-fraction sublattice points. For simplicity, 
we assume the sublattice A^ is clean (if not, the algorithm still works by employing a rule to break a 
tie on the boundary of a sublattice Voronoi cell). According to Property |3j no point A G A is on the 
boundary of any Voronoi cell of Ag/^^. Let 

6(t) = {(Ai, A2, • • • , Xk) G Af |Ei<fc<^Afc/K = r} (21) 

be the set of all ordered ii'-tuples of sublattice points of centroid r, and r G Ag/j^ by Property 1. 

In constructing an index assignment, we sort the members of fi(r) by J2k=i W^k — ''"IP- From fi(r) 
we select the ordered K-tuples in increasing values of J2k=i{Xk — t)^ to label the central lattice points 
inside the i^-fraction Voronoi cell Vg/x{T), until all Nt = |A n Vg/K{T)\ of those central lattice points 
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are labeled. It follows from (fTTb that any bijective mapping between the n(r) central lattice points and 
the A'^^ ordered K-tuples of sublattice points yields the same value of dg. Such an index assignment 
clearly minimizes the second term of (ITTl . which is the sum of the squared distances of all central lattice 
points in Voronoi cell Vs/k{t) to the centroid r = fi{a{-)). As — > cxo, the proposed index assignment 
algorithm also minimizes the first term of (fTTl independently. This will be proven with some additional 
efforts in Section Hvl 

For the two description case, these A'^^ ordered pairs are formed by the N-j- nearest sublattice points 
to r in As by Property @] Note when r G A^, the ordered pair (r, r) should be used to label r itself. 

According to Property |^ A^,/^ has cosets with respect to A^ in the L-dimensional space, so there 
are classes of V^/xi'^)- We only need to label one representative out of each class, and cover the 
whole space by shifting. Thus it suffices to label a total of N central lattice points. 




Fig. 2. Optimal index assignments for A2 lattice with — 31, K — 2. Points of A, As and A3/2 are marked by ■, • and +, 
respectively. 
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Fig. 3. Optimal index assignments for A2 lattice with = 73, K = 3. Points of A, and A^/s are marked by •, • and +, 
respectively. 



To visualize the work of the proposed index assignment algorithm, let us examine two examples on 
an A2 lattice (see Figs. Hand |3ll. The A2 lattice A is generated by basis vectors represented by complex 
numbers: 1 and u> = 1/2 + i\/3/2. By shifting invariance of A2 lattice, we only need to label the 
central lattice points that belong to K"^ Voronoi cells of Ag/x- By angular symmetry of A2 lattice, we 
can further reduce the number of points to be labeled. 

The first example is a two-description case, with the sublattice As given by basis vectors 5 — w, 
Lu{5 — ll>), which is geometrically similar to A, has index = 31 and is clean (refer to Fig. |2li. There 
are two types of Voronoi cells of As/2, as shown by the solid and dashed boundaries in Fig. |2l The solid 
cell is centered at a central lattice point and contains 7 central lattice points. The dashed cell is centered 
at the midpoint of the line segment OA, and contains 8 central lattice points. To label the 7 central 
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lattice points in Vg/2{0), we use the 7 nearest sublattice points to O: {O, A, B,C, D, E, F). They form 
6 ordered pairs with the midpoint O : {{A, D), {D, A), {B, E), {E, B), (C, F), (F, C), and an unordered 
pair (0,0) since O is itself a sublattice point. To label the 8 central lattice points in Vg/2{M), we use 
the 8 nearest sublattice points to M: (O, A, B, F, C, H, E, G). They form 8 ordered pairs with midpoint 
M: {0,A), {A,0), {B,F), {F,B), {C,H), {H,C), {E,G), {G,E). The labeUng of the 7 central lattice 
points in Kj/2(0) and the labeling of the 8 central lattice points in 1^/2 (-^) are illustrated in Fig. |2 

Fig. |3l illustrates the result of the proposed algorithm in the case of three descriptions. The depicted 
index assignment for three balanced descriptions is computed for the sublattice of index = 73 and 
basis vectors: 8 — lo, lu{8 — to). 

The presented MDLVQ index assignment algorithm is fast with an 0{N) time complexity. The 
simplicity and low complexity of the algorithm are due to the greedy optimization approach adopted. 

The tantalizing question is, of course, can the greedy algorithm be optimal? A quick test on the above 
two examples may be helpful. Let the distance between a nearest pair of central lattice points in A be 
one. For the first example the result of [4] (the best so far) is ds = 561/31 = 18.0968, while the greedy 
algorithm does better, producing dg = 528/31 = 17.0323. Indeed, in both examples, one can verify that 
the expected distortion is minimized as the two terms of dg in (ITTl are minimized independently. 

IV. Asymptotically Optimal Design of MDLVQ 

In this section we first prove that the greedy index assignment is optimal for any K, p, A and A^ 
as ^ oo. In constructing the proof we derive a close form asymptotical expression of the expected 
distortion of optimal MDLVQ for general > 2. It allows us to determine the optimal volume of a 
central lattice Voronoi cell u, the optimal sublattice index A^, and the optimal number of descriptions 
K, given the total entropy rate of all side descriptions Rt and the loss probability p. These results, in 
addition to optimal index assignment a, complete the design of optimal MDLVQ, and they present an 
improvement over previous work of [10]. 

A. Asymptotical Optimality of the Proposed Index Assignment 

Since the second term of ds is minimized by the Voronoi partition defined by the K-fraction lattice, the 
optimality of the proposed index assignment based on the K-fraction lattice follows if it also minimizes 
the first term of ds- This is indeed the case when ^ cxd. To compute the first term of dg, let 

k 

^k = ^\,k = l,2,--- ,K, 

i=l 
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Then 

fe=i 



K 

E 

k=l 
/K-1 



Afe - —^K 



(a) 



E 

'if-i 

E 

,fc=i 

,E 

K-l 



Afc - 



+ 



A^ - ;^<?^ 



A. - J^'^K-l) + ^ Uk-1 - 



+ 



K - 1 



^ii'-i 



K 



Afc 



+ 



K 



K-l 



K-l 



K 



(6) fc + 1 



SE 



ifc=i 



(22) 



Equality (a) holds because the inner product ^X^j^i^ ^A^ — ■^zi'iK-i^ , {'iK-i — ^^e^'^k)^ is zero. 
After using the same deduction K-l times, we arrive at equaUty {b). 

Note the one-to-one correspondence between (Ai, A2, • • • , Xk) and (^1, <?2, • ■ ■ , <?i<")- Also recall that 
the proposed index assignment uses the Nj- (the number of central lattice points in iT-lraction Voronoi 
cell /k(t)) smallest X-tuples in fi(r) according to the value of J2k=i II Afc— Tp. Finding the A^^ smallest 



values of J2k=i II Afc— 7"|P in 6(t) is equivalent to finding the N-,- smallest values of X^j^i^ 



fc-l_i?fc+i 



among the {K - l)-tuples (ft, ?2, • • • , <^K-i) with = J2k=i Afc- 

Theorem 1: The proposed greedy index assignment algorithm is optimal as N ^ 00 for any given A, 
As, K, and p. 

Proof: The z*'* nearest sublattice point to ^^ft+i is approximately on the boundary of an L- 
dimensional sphere with volume iNu. Given ^^fc+i, the i^^ smallest value of — ^^ft+ip is ap- 
proximately {iNv/BL)i /L = Gl{1 + j){iNv)i, where Bl = {L + 2)~^ is the volume of an 
L-dimensional sphere of unit radius [4], and Gl is the dimensionless normaUzed second moment of an 
L-dimensional sphere. 

Let /(")(t) be the n*^ smallest value of Y^k^i II Afc - rf in fi(r) that is realized at (?i"\ 
Then 



K-l 



k + l 



k=i 



k 



An) 
^k 



k (n) 
"^fc+1 



k + l 



(23) 



fc=i 
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in which • • • , i^^^i) € is where the sum J2^=i takes on its n*^ smallest value 

over all {K — l)-tuples of positive integers. 

When ^ oo, the proposed index assignment algorithm takes the N-j- « N/K^ smallest terms of 
Yl!k=i ll-^fc ~ ''"ll^ iri ^{'t) for every r. But d23b states that the -n}^ smallest value of '}2k=i W^k — 't\\^ is 
independent of r. Therefore, the first term of ds is minimized, establishing the optimality of the resulting 
index assignment. ■ 

Remark IV. 1: The 0{N) MDLVQ index assignment algorithm based on the iC-fraction lattice is so far 
the only one proven to be asymptotically optimal, except for the prohibitively expensive linear assignment 
algorithm. In the next section, we will strengthen the above proof in a constructive perspective, and 
establish the optimality of the algorithm for finite N when K = 2. 



B. Optimal Design Parameters v, N and K 

Now our attention turns to the determination of the optimal u (the volume of a Voronoi cell of A), 
N (the sublattice index) and K (the number of descriptions) that achieve minimum expected distortion, 
given the total entropy rate of all side descriptions Rt and loss probability p. 

Using (I23t . we have 



K 



K 



K-1 



rtT. 



k + l 



Nr 



n=l k=l 



k 



in) 



K (n) 
K-l 



(24) 



n=l k=l 



Consider the region defined as 



, ^ A; + 1 



k=l 



(25) 



Choose C appropriately so that the volume of Q is V{Q) = Nr- As Nr ^ oo, ^ contains approximately 
Nr optimal integer vectors {11,12,- ■■ ,iK-i)- These Nr points are uniformly distributed in Q, with 
density one point per unit volume. Because the ratio between the volume occupied by each point and the 
total volume is 1/Nr, which approaches zero when Nr —>■ 00, we can replace the summation by integral 
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(26) 



and get 

fyeno dy 

where yk = {^^)^Xk, /c = 1, 2, • • • ,K — 1, and JIq is defined as 

^0 = I'^Vk < C\yi,y2,-- ■ ,yK-i > 0,yi,y2- • • € M > . (27) 

Substituting (I26t into (I24t . we have 

j:i:\\Xk- M(a(A)) f P(A) « + |) (iV.)r ^^^"^^^^"^'f ^''^ 
Let F(r2o) be the volume of region ^Iq, i.e., 

V{no) = / dyi (iy2 • • • dyx-i 

= K~ / dxi dx2 ■ ■ ■ dxK-i 

Jxen (29) 

= K^N^ 

and define the dimensionless normalized |;th moment of Qq: 

^ A 1 lyena ^k=i Vk dy 

(^Qa = -77 7 1 I 2 (30) 

^-1 F(17o) ^^<^ 

Note that scaling JIq does not change For the special case L = 1, the region Qq is a {K — 1)- 
dimensional sphere in the first octant, so the normalized second moment Gq^ = AGk-i- For the special 
case K = 2, Gqq = L/{L+2) is the normaUzed ;^th moment of a line [0, C\. Generally, using Dirichilet's 
Integral [16], we get 

1 r(^ + i)^ 

n + l r(| + l)r 

Hence, 

!ym, Efe=i yk dy ^ ^^^^^^ _ ^ ^^^^^ _ ^^2) 
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Substituting i32l into (I28t . we have 

1 ^ 2 - 

AeA k=i (33) 

where 

i + |r(^ + i)^ 



n + l r(f + i)i 



Note = 12G„ and = 1. 

When N ^ oo, Nr ^ N/K^ independently of the cell center r. The Nr central lattice points are 
uniformly distributed in Vg/xiT) whose volume is approximately Nriy. Hence the second term of dg can 
be evaluated as 

C ||A - Ka{X))f P{X) « CGA{Nri^)T 
AeA (34) 

Comparing ( B?b with the first term of dg dominates the second term when N ^ oo, thus 

ds^ Gl^k-i,l{K -l)K^^N^^^)vT. (35) 

Substituting (I35t and ^ into (fTSl . we finally express the expected distortion of optimal MDLVQ in 
a closed form: 

D^{1- p^)GAui + C2Gl^k-i,l{K - l)K^7VM^i/f + ]. (36) 

Using a different index assignment algorithm 0stergaard et al. derived a similar expression for the 
expected MDLVQ distortion (equation (35) in [10]): 

D* « {1-p'^)GkA + KGliPIN^^^vT +p^E[\\X\W (37) 



where 

K-l 



'^-E 'O-rtV-^ (38, 

and %l)L i& & quantity that is given analytically only for K = 2 and for = 3 with odd L and is 
determined empirically for other cases. 
To compare D and D* , we rewrite d36l) as 

{1 - p^)GAui + KGl^^IN^^ +p^E[\\Xf], (39) 
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where 

ijL = ^2K^$x-i,L. (40) 

The two expressions are the same when = 2 for which ipL = '4'L = 1> but they differ for K > 2. 
Table U lists the values of V'l and -0^^ for K = 3, and it shows that -i/^oo = ipoo = (|)^' and tpL < i^L for 
other values of L. This implies D < D*, or that our index assignment makes the asymptotical expression 
of D tighter. 



L 




i'L--- 


1 


1.1547... 


0.9549... 


2 


1.1481... 


0.9428... 


3 


1.1346... 


0.9394... 


5 


1.1241... 


0.9400... 


7 


1.1173... 


0.9431... 


9 


1.1125... 


0.9466... 


11 


1.1089... 


0.9498... 


13 


1.1060... 


0.9527... 


15 


1.1036... 


0.9552... 


17 


1.1017... 


0.9575... 


19 


1.1000... 


0.9596... 


21 


1.0986... 


0.9614... 


51 


1.0884... 


0.9763... 


71 


1.0856... 


0.9807... 


101 


1.0832... 


0.9848... 


oo 


1.0746... 


1.0746... 



TABLE I 

Values of ipL and ipL in L for K = S. Values of iIjl are reproduced from Table 1 in [10]. 



Now we proceed to derive the optimal value of N, which governs the optimal trade-off between the 
central and side distortions for given p and K. For the total target entropy rate Rt = KR, we rewrite 
^ to get 

jVzy = 2-^*^^*^P)~^'/'^\ (41) 

For simplicity, define 

^A2LWp)-R./k)^ (42) 
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L{K-1) 
2K 



and we have 

D = {l-p^)GKvi + C2Gl^k-iAK - l)K^^rj^^u^<^ +p^E[\\Xf]. (43) 
Differentiating D with respect to u yields the optimal u value: 

f C2 Gl '^k~i ,l 

Substituting Uopt to d^Tl . we get optimal A^: 

L(K-l) 

If ii' = 2, the expression of Nopt can be simplified as 

■2{1+p)0a 



Remark IV.2: Nopt is independent of the total target entropy rate Rt and source entropy rate h{p). It 
only depends on the loss probability p and on the number of descriptions K. Substituting Vopt into (143 1 . 
the average distortion can be expressed as a function of K. Then optimal K can be solved numerically. 

Remark IV.3: When K = 2, ( l^5t can be simplified to 

ds^-^GL{N\)T. (46) 

For any a € (0,1), let N = 2^('^^+^), then v = 2^(^(p)-("+i)«-i). Since R ^ 00 implies N ^ 00, 
substituting the expressions of N and v into (Isjl and (l46t . we get 

lim 422^(1+'') = -Ga22Mp) 
lim 42^^(1-'^) = Gl2'^^'~p\ k = l,2 

i?— >oo 

Therefore, the proposed MDLVQ algorithm asymptotically achieves the second-moment gain of a lattice 
for the central distortion, and the second-moment gain of a sphere for the side distortion, which is the 
same as the expression in [4]. In other words, our algorithm realizes the MDC performance bound for 
two balanced descriptions. 

V. Non-asymptotical Optimality for K = 2 

In this section we sharpen the results of the previous section, by proving non-asymptotical (i.e., with 
respect to a finite N) optimality and deriving an exact distortion formula of our MDLVQ design algorithm 
for IT = 2 balanced descriptions, under mild conditions. The following analysis is constructive and hence 
more useful than an asymptotical counterpart because the value of N is not very large in practice [7]. 
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A. A Non-asymptotical Proof 

Our non-asymptotical proof is built upon the following definitions and lemmas. 
Definition 1: A sublattice is said to be centric, if the sublattice Voronoi cell Vs{X) centered at 
A G As contains the N nearest central lattice points to A. 
Figs. |2l and |3] show two examples of centric sublattices. 

To prove the optimality of the greedy algorithm, we need some additional properties. 

Lemma 1: Assume the sublattice A^ is centric. If A G Vs/2{t) and A V's/2(^)' where A,A G A and 
r, f G Ag/2> then ||A — t|| < ||A — f||. 

Proof: Scaling both A and ^5/2(7") by 2 places the lattice point 2 A in Vs{2t); scaling both A and 
Vs/2{f) by 2 places the lattice point 2A Vs{2f). Since a sublattice Voronoi cell contains the nearest 
central lattice points, ||2A — 2r|| < ||2A — 2f||, and hence ||A — r|| < ||A — f||. ■ 

Definition 2: A sublattice A^ is said to be S'-similar to A, if A^ can be generated by scaling and 
rotating A around any point r G As/2 ^^d A^ C A. 

Note that the 5-similarity requires that the center of symmetry be a point in As/2- 

In what follows we assume that sublattice A^, is S'-similar to A. Also, we denote by Vr the region 

created by scaling and rotating Vs/2{t) around r. 

Lemma 2: If A^ G Vr and A^ Vf, where A^, A^ G A^ and r, f G As/2, then \\\s — r|| < \\\s — f\\. 

Proof: This lemma follows from Lemma ^ and the definition of S'-similar. ■ 
Lemma 3: Vr G As/2, the sublattice points in Vt form |A n Vs/2{t)\ nearest ordered 2-tuples with 

their midpoints being r. 

Proof: Letting f = r in Lemma |2l we see that Vr contains the |As n V^rl = |A n Vs/2{t)\ nearest 
sublattice points to r. And these sublattice points are symmetric about r according to Property |3 Thus 
this lemma holds. ■ 
Theorem 2: The proposed index assignment algorithm is optimal for = 2 and any N, if the sublattice 
is centric and ^-Similar to the associated central lattice. 

Proof: By Property [l] for any Ai, A2 G A^, (Ai + A2)/2 G As/2- Now referring to (fT9t . the proposed 
algorithm minimizes the second term J2\eA 11^ ~ ('^1 + ^2)/2\\'^P{X) of ds, since it labels any central 
lattice point A G Vs/2{t) by (Ai, A2) G A^, and (Ai + A2)/2 = r. 

The algorithm also independently minimizes the first term YlxeA ill-^i ~ A2|P-P(A) of ds- Assume that 
J2xeA 11-^1 ~ '^2|P^(A) was not minimized. Then there exists an ordered 2-tuple (Ai, A2) G Ag which is 
not used in the index assignment, and ||Ai — A2II < ||Ai — A2II, where (Ai, A2) G A^ is used in the index 
assignment. Let r = (Ai + A2)/2, f = (Ai + A2)/2. Since (Ai, A2) is used to label a central lattice point in 
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^s/2{t)^ -^1) -^2 S Vr by Lemma|3l However, Ai, A2 Vf, otherwise (Ai, A2) would be used in the index 
assignment by Lemma|3l So we have ||Ai — r|| < ||Ai — f|| by Lemma|2j hence ||Ai — A2II < ||Ai — A2II, 
contradicting ||Ai — A2II < ||Ai — A2II. ■ 

Remark V. 1 : A sublattice Voronoi cell being centric is not a necessary condition for the optimality of 
the greedy algorithm. For instance, for the A2 lattice generated by basis vectors 1 and u) = 1/2 + i^/3/2 
and the sublattice of index = 91 that is generated by basis vectors 9 — lo{9 — uj), a sublattice 
Voronoi cell does not contain the N nearest central lattices, but the greedy algorithm is still optimal as 
the two terms of dg are still independently minimized. This is shown in Figure |3 

Remark V.2: It is easy to choose a centric sublattice for relatively small N and in high dimensional 
lattices. For instance, the sublattices of A2 lattice shown in Fig. |2 Fig. |5] are centric. And any sublattice 
of Z lattice is centric. 

B. Exact Distortion Formula for K = 2 

We have derived an asymptotical expected distortion formula ( 1^ of the proposed MDLVQ design, 
which improved a similar result in [10]. But so far no exact non-asymptotical expression of the expected 
MDLVQ distortion is known even for balanced two descriptions. This subsection presents a progress on 
this account. 

Lemma 4: If the sublattice is clean and S-similar, then the second term of ds for the proposed optimal 
MDLVQ design for K = 2 is 

5:i|A-m,2fP(A) = ^^, (47) 

aga 

where is the squared distance of the i^^ nearest central lattice point in Vs{Q) to the origin. 

Proof: Kg 12 has 2^ cosets with respective to in the L-dimensional space. Let ti , T2 , • • • , T2l 
be representatives of each coset. For example, when L = 2, ri = (0, 0)Gs,r2 = (0, ^)Gs,r3 = 
(^,0)Gs,r4 = {\, \)Gs- Denote by V\{t) = 14/2(t) the set of central lattice points in the Voronoi 
cell of a 2-fraction sublattice point r. We first prove that 

2 {Vx{Ti) - Ti) n 2 {Vx{Tj) - T,) = 0. (48) 

t} 2{Vx{Ti)-Ti) = Vs{Q)r\K. (49) 

Here for convenience, we denote by 2V the set of lattice points that is generated by scaling the lattice 
points in Voronoi cell V hy 2. 
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Fig. 4. The greedy algorithm is optimal for — 91, although the sublattice is not centric. The 19 central lattice points in 
Vs/2(0) are labeled by the 19 nearest ordered 2-tuples with centroid O. The 24 central lattice points in Vs/2(M) are labeled 
by the 24 nearest ordered 2-tuples with centroid A/. Let the edge length of 2-tuple {0,A) be one: \\0 — A\\ = 1. The 19th 
{20th) nearest ordered 2-tuple with centroid O has edge length 4 (2\/7). The 24t/i {25th) nearest ordered 2-tuple with centroid 
M has edge length 5 (3\/3)- Because 4 < 3\/3 and 5 < 2\/7, the first term of ds is minimized. The second term of ds is 
minimized because the greedy algorithm partition the space by the Voronoi cells of the A'-fraction sublattice. 



Assume that i4Sl does not hold. Then there exist Aj S V\{Ti), Xj £ V\{Tj) such that Aj — = Xj — tj. 
Let tq = Ti — Tj, then tq G Ag/2- We also have tq = Aj — Aj, so tq G A. The sublattice A^ is 5-similar to 
A, so properly rotating and scaling A around the 2-fraction sublattice point tq can generate Ag. Rotating 
and scaling the central lattice point tq G A around tq itself generates tq, so tq = tj — Tj G A^. This 
contradicts that Tj and tj are in different cosets with respect to A^, establishing (l48b . 

To prove fi9l . we first show that for any r G Ag/2> 

2iVxiT) - r) = 2 (y,/2(r) n A) - 2r = y,(2r) n (2A) - 2r C y,(0) n A. (50) 
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Step (a) holds because 2t G A and Vs{2t) — 2t = Vs{0). Therefore, 

U 2 (Va (r.)-Ti) CV;(0)n A. (51) 
1=1 

According to Property |3j no central lattice points lie on the boundary of a i^-fraction Voronoi cell when 
the sublattice is clean, so the set ujti Vx{Ti) contains N different central lattice points. By (R^ . the set 
uf^i 2 (yx{Ti) — Ti) has N different elements. Because the set Vs{0) n A also has N different elements 
and uf^i 2 {Vxin) - n) C 14(0) n A, ^ holds. 
Finally, it follows from and (U^Jl that 

5^ ||A - /.(a(A))f P(A) = ^ 5] ||2A - 2/.(a(A))f P(A) 
aga aga 

AN ^ II »ll 

«=i agVaCtO (52) 

4iV ^ " " 

AGv;{o)nA 



4L N 

Equality (a) holds because under high resolution assumption, P{X) is the same for each central lattice 
point A G uf=i Vx{Ti). ■ 
Theorem 3: If the sublattice is clean, 5-similar and centric, then the expected distortion D of optimal 
two-description MDLVQ is 

1 ^ 

D = {1-p')GkvT + -p{i-p)L-\l + NT)N-^Y,"^i +P'E[\\X\\\ (53) 

_ 1=1 
Proof: By Theorem |2l under the stated conditions, the proposed MDLVQ design is optimal. Further, 

the corresponding index assignment makes the first term of dg exactly A^^ times the second term of ds. 

Then it follows from Lemma ^ that the first term of ds is 

'L\\\^^-M\'pm = ^^f^■ (54) 

AeA 

Substituting Wh and ( I5?l l into ( I15t . we obtain the formula of the expected distortion D in ( 15^ . ■ 
The above equations lead to some interesting observations. When the sublattice is centric, ai is also 
the squared distance of the i*^ nearest central lattice point to the origin. The term N~ N^'^ J2iLi (^i is 
the average squared distance of the A^ nearest sublattice points to the origin, which was also realized 
by previous authors [4]. The other term A^^^ J2iLi o-i is the average squared distance of central lattice 
points in 1^(0) to the origin. 
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The optimal v and N for a given entropy rate of side descriptions can be found by using (I53t and 
Rs = h{p) — log2 Nv (shown in Q), rather than solving many instances of index assignment problem 
for varying A^. 

VI. S'-SlMILARITY 

The above non-asymptotical optimality proof requires the S'-similarity of the sublattice. In this section 
we show that many commonly used lattices for signal quantization, such as A2, Z, Z^, Z^{L = Ak), 
and {L odd), have 5-similar sublattices. 

Being geometrically similar is a necessary condition of being 5'-Similar, but being clean is not 
(For example a geometrically similar sublattice of A2 with index 21 is 5-Similar but not clean). The 
geometrical similar and clean sublattices of A2, Z, Z"^, Z^{L = Ak), and Z^ {L odd) lattices are 
discussed in [5]. We will discuss the 5'-Similar sublattices of these lattices in this section. 

Theorem 4: For the Z lattice A, a sublattice is 5-Similar to A, if and only if its index N is odd. 
Proof: Staightforward and omitted. ■ 

Theorem 5: For the A2 lattice A, a sublattice A^ is 5-similar to A, if it is geometrically similar to A 
and clean. 

Proof: Let A^ be a sublattice geometrically similar to A and clean. We refer to the hexagonal 
boundary of a Voronoi cell in A (respectively in A^) as A-gon (respectively A^-gon). Any point r G A3/2 
is either in A^ or the midpoint of a A^-gon edge. For instance, in Figure |2 M is both the midpoint of a 
A-gon edge and the midpoint of a A^-gon edge. 

If r G As, then r G A, hence scaling and rotating A around r yields A^ in this case. If r is the 
midpoint of a A^-gon edge, then r A because sublattice A^ is clean, but r G ^1/2^ so r is the midpoint 
of a A-gon edge, hence scaling and rotating A around r yields A^ in this case. ■ 

The Z^{L = 41,1 > 1) lattice has a geometrically similar and clean sublattice with index A^, if and 
only if = m2 , where m is odd [5]. Here we show that there are S'-similar sublattices for at least half 
of these N values. 

Theorem 6: The Z^{L = 41,1 > 1) lattice A has an 5-similar, clean sublattice with index N, if 
N = with m = 1 mod 4. 

Proof: We begin with the case L = 4. By Lagrange's four-square theorem, there exist four integers 
a,b,c,d such that m = + 6^ + + d^. The matrix constructed by Lipschitz integral quaternions 
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= a + 6i + cj + dk} [5] is 



\ 



abed 
—b a d —c 
—c —d a b 
—d c —b a 

The lattice generated by matrix Gs = is a geometrically similar sublattice of A. 



Let X = u, Xs = UgG^, T = ^UrG^ be a point of A, A^, A5/2 respectively, where u, Us,Ur G Z^. Then, 



-U^)G/:. 



Let u = u — u^^{G^ — II), where 1^ is, an L k L identity matrix, then 



Since -n? = 1 mod 4 or 



n 



X — T = U — -^Ur- 

mod 4 depending on whether n is an odd or even integer, m = 1 mod 4 



implies that exactly one of a,b,c,d is odd. Letting a be odd and b,c,d even, then ^{G^ — II) is an 
integer matrix. Hence u e Z^. Thus, scaling and rotating A around point r by scaling factor /3 = m^/^ 
and rotation matrix A = m^^^'^G^ yields A^, proving A^ is 5-similar to A. 

For the dimension L = 4Z, / > 1, let the 41 x 4/ generator matrix of the sublattice A^ be 

f G^ ••• \ 
G^ ■■■ 
: : ■•■ 
V ••• / 

Then A^ is S'-similar to A. And according to [5], A^ is clean. ■ 
The Z2 lattice A has a geometrically similar sublattice Ag of index A^, if and only if = + a, 6 G 
Z. And a generator matrix for A^ is 

Gs=\ " I . (55) 
\-b a) 

Further, A^ is clean if and only if N is odd [5]. 

Theorem 7: For the Z2 lattice A, a sublattice A^, is S'-similar to A, if it is geometrically similar to A 
and clean. 

Proof: For a geometrically similar and clean sublattice A^, its generator matrix Gg is given by \55\ . 
As N = a"^ + b"^ is odd, a and b are one even and the other odd. Letting a be odd and b even, by the 
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same argument in proving Theorem |6l scaling and rotating A around any point r G As/2 by scaling factor 
P = N^/"^ and rotation matrix A = N^^^'^Gg yields A^. If a is even, b is odd, scaling and rotating A 
around any point r € by scaling factor /3 and rotation matrix A yields A^, where A is an orthogonal 
matrix: 

A = A 



-l\ 


1 = 1 


( b -a\ 




[l I 




[a b 



Theorem 8: An L-dimensional lattice A has an S'-similar sublattice with index A^, if = is odd. 
Proof: Constructing a sublattice A^ with index N = needs only scaling, i.e., Gg = mG. Let 

A = uG, \s = mUgG, T = \mUrG be in A, A^, As/2 respectively, where u,Us,Ur G Z^. Then, 



As - T = m{us - ^Ur)G. 



Let u = u — ^^^T^Ur, then -u G Z , and 



A — r = (n — -Ur)G. 



Thus, scaling A around point r by /? = m^/^ yields A^, proving A^ is 5-similar to A. ■ 
Corollary 1: The {L is odd) lattice A has an S-similar, clean sublattice with index A^, if and only 
if = is odd. 

Proof: By [5], A has a geometrically similar, clean sublattice of index A^, if and only if A^ = 
is odd. A sublattice A^ of this index can be obtained by scaling A by m. Theorem [8l implies that A^ is 
5-similar to A. ■ 

VIL Local Adjustment Algorithm 

Theorem |2l is concerned with when the two terms of ds in (fTTl can be minimized independently by 
the greedy index assignment algorithm. While being mostly true for if = 2 as stated by the theorem and 
as we saw in Fig. 2 and Fig. 4 ??, this may not be guaranteed when K > 2. Fig. |5] presents the index 
assignment generated by the greedy algorithm for if = 3 on A2 lattice. The solution is now suboptimal. 
Indeed, consider the central lattice point in 1/5/3 (T) tbat is labeled by OAC in Fig.|5j changing the label 
from OAC to BOA will reduce ds of the central lattice point in question. The change reduces the first 
term of dg, although the second term of ds increases slightly. Note that the 3-tuple (O, A, C) has centroid 
T, and the 3-tuple [B, O, A) has centroid M. 

In order to make up for the loss of optimality by the greedy algorithm, we develop a local adjustment 
algorithm. If a central lattice point A is labeled by an ordered if -tuple that has centroid r G Ag/x, we 
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Fig. 6. Remove lattice A from site a, and add it to site b 

say that A is attracted by site r. If two Voronoi cells Vs/k{'''i) ^s/E'(^2) are spatially adjacent, we 
say that site ti and site T2 are neighbors. In Figure |5] site O and site T are neighbors, while site O and 
site M are not neighbors. 

In Fig. 1^1 assume two neighboring sites a and b attract m and n central lattice points respectively. The 
m (n) central lattice points are labeled by m (n) nearest ordered ii'-tuples centered at site a (b). For any 
point X G R^, let J-t(x) be the projection value of x onto the axis ab. Consider the set S{a) of all the 
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m points currently attracted by site a, and find 

^max = arg max J-t{X). (56) 

XeS{a) 

Now, introduce an operator ^ (a, b) that alters the label of Xmax to an ordered K-tuple of sublattice 
points centered at h. The effect of (a, h) is that sites a and h attract m — 1 and n + 1 central lattice 
points respectively, which are respectively labeled by m — 1 and n + 1 nearest ordered K-tuples centered 
at site a and site h. 

^From the definition of side distortion dg = X^AeA '^W^W i'^ ' I17t . we have 

Let us compute the change of d{\jnax) caused by the operation r' (a, h). 
The change in the second term of d{\max) is 

C 1 1 ^max ^11 II ^max O, | 



Y^ii^J'^i^max) — L\\b — a\\^ — J-^iXmax)"^ 



(58) 



Note the change of the second term is positive if Xmax S Vs/Kici)- 
The change in the first term is 

fb{n + l)- fa{m), (59) 

where frii) is the i^^ smallest value of J2^=i W^k — ^W"^ over all ordered K-tuples (Ai, A2, • • • , Xk) S 
such that m(Ai, A2, • • • , A^) = t. 
The net change in d{Xmax) made by operation r* (a, b) is then 

A{a,b) = C(\\Xjnax - - \\Xmax " alH + fb{n+ 1) - /a(m.). (60) 



If A(a,6) < 0, then {a,b) improves index assignment. 

The preceding discussions lead us to a simple local adjustment algorithm: 

{a*,b*) = argmin^ neighbors b ^("' 
While A(a*,6*) < do 
^ (a, 6); 

(a*, 6*) = argmin^ neighbors b ^(«' 

Note that it is only necessary to invoke the local adjustment \* (a, h) if the greedy algorithm does not 
simultaneously minimize the two terms of ds- 
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Fig. 7. Optimal index assignments for tlie A2 lattice, = 31, K = 3. Points of A, As and As/3 are marked by ■, • and +, 
respectively. 

Fig.Qshows the result of applying the local adjustment algorithm to the output of the greedy algorithm 
presented in Fig. |5] It is easy to prove that the local adjustment algorithm indeed finds the optimal index 
assignment for this case of three description MDLVQ. 

Finally, we conjecture that a combined use of the greedy algorithm and local adjustment \* (a, b) solves 
the problem of optimal MDLVQ index assignment for any L-dimensional lattice and for all values of K 
and N. 

VIII. Conclusion 

Although optimal MDLVQ index assignment is conceptually a problem of linear assignment, it involves 
a bijective mapping between two infinite sets A and A^ . No good solutions are known to reduce 
the underlying bipartite graph to a modest size while ensuring optimality. We developed a linear-time 
algorithm for MDLVQ index assignment, and proved it to be asymptotically (in the sublattice index 
value A^) optimal for any K > 2 balanced descriptions in any dimensions. For two balanced descriptions 
the optimality holds for finite values of A^ as well, under some mild conditions. We conjecture that the 
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algorithm, with an appropriate local adjustment, is also optimal for any values of K and N. 

The optimal index assignment is constructed using a new notion of K-fraction lattice. The K-fraction 
lattice also lends us a better tool to analyze and quantify the MDLVQ performance. The expected distortion 
of optimal MDLVQ is derived in exact closed form for K = 2 and any N. For cases if > 2, we improved 
the current asymptotic expression of the expected distortion. These results can be used to determine the 
optimal values of K and N that minimize the expected MDLVQ distortion, given the total entropy rate 
and given the loss probability. 
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